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Abstract 

.  Erhpirical  Bayes  estimators  for  the  scale  parameter  in  a  Weibull, 
Raleigh  or  an  exponential  distribution  with  type  II  censored  data  are 
developed.  These  estimators  are  derived  by  the  matching  moment 
method,  the  maximum  likelihood  method  and  by  modifying  the 
geometric  mean  estimators  developed  by  Dey  and  Kuo  (1991).  The 
empirical  Bayes  risks  for  these  estimators  and  the  Bayes  rules  are 
evaluated  by  extensive  simulation.  Often,  the  moment  empirical  Bayes , 
estimator  has  the  smallest  empirical  Bayes  risk.  The  cases  that  the 
modified  geometric  mean  estimator  has  the  smallest  empirical  Bayes 
risk  are  also  identified.  We  also  obtain  the  risk  comparisons  for  various 
empirical  Bayes  estimators  when  one  of  the  parameters  in  the 
hyperprior  is  known. 
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1.  INTRODUCTION 

In.  reliability  analysis,  we  often  conduct  similar  tests  to  assess  the 
reliability  parameters.  Empirical  Bayes  (EB)  estimators  may  be  .employed  to 
reduce  the  risk  by  combining  all  the  test  data.  There  are  usually  several 
reasonable  empirical  Bayes  estimators.  As  pointed  out  by  Martz  and  Waller 
(1982,  p.  633),  it  is  an  important  question  which  EB  estimator  has  the  smallest 
EB  risk  (the  expected  Bayes  risk  of  the  EB  rule).  We  report  here  some  Monte 
Carlo  results  that  estimate  the  EB  risks.  These  results  will  guide  us  in 
determining  which  EB  estimator  is  more  desirable. 

We  assume  that  we  are  simultaneously  testing  p  populations.  For  the 
population,  i  =  1, ...,  p,  we  test  m  devices  until  r;  of  them  fail.  The  lifetime  for 
each  device  tested  in  the  i‘^  population  is  assumed  to  be  Weibull  with  known 
shape  parameter  p,-  and  unknown  scale  parameter  Xi, 

JfL 

This  model  includes  the  exponential  (p,-  =  1)  and  Raleigh  (p,-  =  2)  distributions. 
Let  ti  =  (ffi ...,  Ur)  denote  the  ordered  lifetimes  of  the  n  devices  that  failed 

in  the  population,  where  tn  < ...,  <  Ur-  Then  S,-  =  («,• 

sufficient  statistic  for  A/  with  gamma  distribution  G(rf,Af). 

In  this  paper,  we  consider  a  parametric  empirical  Bayes  formulation.  We 
assume  the  parameters  A,-  are  independent  and  identically  distributed  with 
the  inverted  gamma  distribution  lG{a,  p).  This  conjugate  prior  is  chosen  to 
facilitate  a  closed  form  expression  for  the  Bayes  estimator  Aj.  To  obtain 
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empirical  Bayes  estimators,,  we  are  going  to  estimate  a  and  from  the 
marginal  density  of  S;  given  a  ^d  p.  We  then  substitute  these  estimates  a 

A 

and  p  for  the  a  and  p  in  the  Bayes  rule.  Usually,  we  csai  estimate  a  and  P  by  a 
moment  method  or  by  an  ML-II  method.  The  moment  method  estimates  ct 
and  P  by  equating  functions  of  a  and  p  to  the  marginal  mean  and  the 
marginal  variance  respectively,  the  ML-II  method  obtains -the  maximum 
likelihood  estimates  of  a  and  p  from  the  joint  density  of  Si,  Sz, .../  Sp  given  a 
and  p.  Recently,  Dey  and  Kuo  (1991)  have  obtained  a  different  EB  estimator 
when  a  is  known.  This  estimator  expands  the  usual  estimator  by  a  multiple 
of  the  geometric  mean  of  the  component  estimators.  They  show  the 
geometric  mean  estimator  dominates  the  best  multiple  estimator  (in 
frequentists'  risk)  for  a  wide  class  of  p,  a,  and  ri  values.  In  this. paper,  we 
propose  a  modified  estimator  called  the  hybrid  .geometric  mean  estimator 
which  estimates  a  by  the  moment  method  and  estimates  P  as  in  Dey  and  Kuo. 

We  compare  the  EB  risks  of  the  three  EB  estimators:  moment;  EB,  ML-II 
EB  and  hybrid  geometric  mean  EB.  The  EB  risks  cannot  be  expressed  in  closed 
form.  We  employ  extensive  Monte  Carlo  simulations  to  approximate  these 
EB  risks.  Oiir  simulation  resuUs  show  that  all  the  three  EB  estimators 
perform  well  when  compared  to  the  Bayes  estimator  for  a  ^  5,  ^  2: 5,  ri  >  5,  for 
all  i  and  p  >  5. 

If  we  fix  the  number  of  censored  devices,  say  for  example,  r;  =  2  for  all  i, 
our  recommendation  depends  on  the  different  a  and  P  values.  A  more 
detailed  discussion  is  given  in  Section  3.  In  general,  it  is  safe  to  recommend 
the  moment  EB  estimator.  Unless  we  are  in  the  situation  with  moderate  a 
and  moderate  P  values  (around  a  =  5  and- p  =  3),  where  the  hybrid  geometric 
mean  estimator  is  recommended.  Unfortunately,  our  recommendation 
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depends  on  the  unknown  a  and  values.  This  should  not  deter  us  in  using 
the  recommended  estimators,  since  we  do  discuss  various  methods  in 
estimating  a  and  /I  in  this  paper. 

If  the  number  of  censored  devices  is  moderate,  say  r;  =  5  for  all  i,  then  we 
would  recommend  using  the  moment  EB  estimators,  for  any  values  of  a 
and  p. 

We  have  also  evaluated  the  EB  risks  for  two  other  cases  (1)  a  known  and 
(2)  P  known.  In  case  (1),  we  compare  the  EB  risks  among  the  Dey  and  Kuo 
(D/>K)  estimators,  the  moment-EB  and  the  ML-II  EB  estimators.  All  three 
estimators  have  comparable  risks  independent  of  a,  p,  ri,  and  p.  In  case  (2), 
we  compare  the  EB  risks  between  the  ML-n  and  the  moment-EB  estimators. 
The  ML-n  EB  is  clearly  a  winner  in  almost  all  cases,  except  the  cases  where 
both  r,-  and  a  are  small,  say  around  r,-  =  2  and  a  =  2. 

Different  classes  of  EB  estimators  are  developed  by  Lemon  and  Krutchkoff 
(1969)  and  Canavos  and  Tsokos  (1971).  Bennett  and  Martz  (1973),  Couture  and 
Martz  (1972)  consider  nonparametric  EB  estimation  of  1/Xp.  Martz  and 
Waller  (1982)  have  also  provided  many  relevant  developments  in  this  area. 

In  Section  2,  we  derive  the  various  estimators  for  risk  comparisons.  In 
Section  3,  we  discuss  the  Monte  Carlo  methods  to  approximate  the  EB  risk 
and  the  results. 

2.  EB  ESTIMATORS 

By  sufficiency  considerations,  observe  that  the  S,-  have  independent 
gamma  distributions  G(r/,  A,).  We  assume  that  the  A,-,  i  =  1,  ...,  p,  have 
independent  inverse  gamma  distributions  IG{a,P),  i.e., 

1 

/  where  a>0,p>  0. 
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The  posterior  distribution  of  A,-  given  S,*  is  IGia+n,  )5/(Si)3+l)),  "Therefore,  the 
Bayes  estimator  for  A,-  with  respect  to  the  squared  error  loss 


5b(0=£(^I^) 


_  Si 


(2-1) 


a+^-1  p(a+ri-iy 

To  construct  EB  estimators,  we  first  obtain  the  marginal  density  of  Si, 

Therefore,  we  can  find  a,  P  which  maximize  the  joint  density  of  the  S{s, 

(2-3) 


In  Appendix  1,  we  show  there  is  a  unique  root  of 
d  d 

— logni(S|a,y3)  =  0  =  -— logm(S|a,/?).  A  sufficient  condition  based  on  the 

second  derivative  test  is  given  to  verify  that  the  unique  root  a,p  yields  the 
maximum  likelihood  estimates  of  (2.3). 

In  addition  to  the  ML-II  method  we  can  also  estimate  a  and  p  by  the 
moment  method.  We  will  assume  r,-  =  r  for  all  i.  Using  the  two  equations  in 
Berger  (1985,  p.  101)  which  relate  the  marginal  mean  and  the  marginal 
variance  to  expectations  from  the  model,  we  have 


H„  =  E’'{rX)  = 


«o-l) 


,  and  oj,  =  E" 


rX^- 


r(o-i) 


Define  /  P/  ^  ~ fimf  /{p~  l)-  We  can  solve  a  and  p  from  (2.4) 

using  fimfClt  to  substitute  for  /i„  and  a^.  We  have 
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«MM  =  and  =  max]^  -^rivOk  (2.5) 

The  truncated  version  is  obtained  because  without  the  condition  a>2'we 
do  not  have  finite  variance  in  the  prior  distribution.  Moreover,:  ^  must  be 
positive.  The  same  truncation  methods  are  also  applied  to  other  EB 
estimators. 

Next  we  will  discuss  how  to  obtain  the  hybrid  geometric  mean  EB 
estimator.  In  Dey  and  Kuo  (1991),  they  show 


EflSf 

f=l 


fj  i^T  J  1^ 
l]  r  a--  r  ri+- 

f  =l  n-L^. 


na) 


Therefore,  they  obtain  an  unbiased  estimator  of  ^ 


i  r(g) 
J..  ■ 


a--]  Hr/+- 

pj.  A  r 


The  Dey  and  Kuo  EB  geometric  mean  estimator  is  obtained  from  (2.1)  with  p 
estimated  from  (2.6)  and  known  a.  However,  the  assumption  of  known  a  is 
too  restrictive  in  practice.  In  this  paper,  we  propose  to  estimate  a  by  a 
moment  condition.  Observe  from  (2.4), 

(Z7) 

<4  cc-l  +  r 

Therefore,  we  can  solve  for  a  from  (2.7)  using  and  for/i^  and  o^. 
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®ratio  ”  ®MM’  (2-8) 

The  hybrid  geometric  mean  EB  estimator  is  obtained  b'om  (2.1)  using  (2.6)  2md 
(2.8)  to  estimate  a  and  p. 

We  have  considered  the  EB  estimators  for  a  and  P  unknown.  We  can 
also  develop  EB  estimators  when  a  is  known.  In  this  case,  we  will  consider 
the  following  EB  estimators:  (1)  the  moment  EB,  where 


(2)  the  ML-n  EB,  where  P  is  estimated  by  maximizing  (2.3)  as  a  function  p  for- 
the  given  known  a;  and  (3)  the  Dey  and  Kuo  (D/K)  EB,  where  P  is  estimated 
from  (2.6). 

For  the  other  case  p  known,  we  estimate  a  by  (1)  the  moment 
consideration 


d:  =  max 


(ZIO) 


and  (2)  the  maximum  likelihood  estimate  of  a  from  (2.3),  i.e.,  the  root  of 
equation  (A.2)  in  the  appendix. 

We  report  the  EB  risk  evaluations  of  these  EB  estimators  in  the  next 
section. 


3.  EB  RISKS 

Recall  the  loss  function  is  defined  by 


6 


The  Bayes  risk  of  a  dedsion  rule  5(S)  =  (5i(S),...,5p(S))  is  defined  by 

r(?r,5(S))  =  J  J  L(X,5(S))/(S|X)dSd;r(X). 

The  EB  risk  of  5(S)  is  the  expected  Bayes  risk,  where  the  expectation  is  taken 
over  all  the  samples. 

EBrisk  =  Er(;r,5(S)).  (3.1) 

The  EB  risk  is  approximated  by  the  Monte  Carlo  method.  In  each 
iteration,  we  generate  A,-,  i  =  1, ...,  p  from  an  IGia,P)  distribution  with  a,p  fixed. 
Given  the  X/s,  we  generate  Xu,  /  =  1, ...,  10  from  the  exponential  distribution 
Exp(Ai).  The  random  variable  tu  =  xj^^  is  distributed  as  (1.1).  We  order  the 

variables  tn  <  tu  <...,<  f,v,  and  compute  S,-  = 

assume  r,-  =  r  and  p,-  =  p  for  all  i.)  We  compute  the  Bayes  rule  Sb  as  in  (2.1). 
We  also  compute  each  of  the  EB  rules  as  in  Section  2.  Then  we  repeat  these 
steps  for  10,000  iterations.  The  EB  risk  is  approximated  by 
^  .  10,000  P  _  ^2 

J  J/'  ' 

where  Xij  is  the  parameter  for  the  population  simulated  in  the  iteration, 
and  dEB.p)  is  the  EB  estimator  for  the  population  in  the  /‘^  iteration. 

Figure  1  plots  the  EB  risk  of  the  Bayes  estimator  (2.1),  the  ML-II  EB  (from 
(A.2)  and  (A.3)),  the  moment  EB  (from  (2.5))  and  the  hybrid  geometric  mean 
EB  (from  (2.6  and  2.8))  for  five  populations  with  r  =  2,  5  and  10.  It  is  expected 
as  r  increases,  the  EB  risk  decreases  because  more  information  on  the 


.  EB  risks  of  the  four  estimators  are  plotted  versus  r  (the  number  of  failures  observed  i 
each  population)  for  a  class  of^onfigurMions  when  both  aand  /J  are  unknown 


lifetimes  is  collected.  Moreover,  the  differences  of  the  EB  risks  of  the  three 
estimators  and  the  Bayes  rule  also  decrease.  We  observe  that  the  Bayes-  rule 
has  the  smallest  risk. 

If  we  fix  the  number  of  censored  devices,  say  for  example,  r,-  =  2  for  all  f, 
our  recommendation  depends  on  the  different  a  and  P  values.  Case  (1):  a  is 
small,  say  around  2.  The  hybrid  geometric  mean  is  the  best.  It  is  a  bit  better 
than  the  moment  EB.  Both  outperform  the  ML-n  EB  by  a  substantial  amount. 
Case  (2):  a  is  large,  say  around  10,  the  moment  EB  is  best.  It  improves  upon 
the  ML-II  EB  by  a  small  amount.  Both  dominate  the  hybrid  geometric  mean 
estimator  by  a  substantial  amount.  Both  cases  1  and  2  are  somewhat 
insensitive  to  the  p  values.  Case  (3):  a  is  moderate,  say  around  5.  Then  the 
performances  depend  on  the  p  values.  V/hen  P  is  small  around  1,  then  the 
moment  EB  improves  the  other  two  by  a  substantial  amount.  When  p  is 
moderate  around  3,  then  the  hybrid  geometric  mean  estimator  improves 
upon  the  other  two  estimators  by  a  substantial  amount.  In  summary,  it  is  safe 
to  use  the  moment  EB  estimators  unless  we  are  in  the  situation  of  moderate 
a,  and  P  values  (around  a- 5  and  p  =  3). 

Next  consider  the  case  that  number  of  censored  devices  is  moderate,  say  r,* 
5  for  all  I.  The  moment  EB  consistently  performs  well  among  the  three 
estimators  independent  of  the  values  of  a  and  p. 

Figure  2  plots  the  EB  risks  of  the  four  estimators  for  various  r  values 
when  a  is  known.  The  four  estimators  are  the  Bayes,  moment,.  ML-II  and  the 
one  developed  in  Dey  and  Kuo  (1991).  The  latter  three  estimators  are 
computed  from  (2.1)  with  P  estimated  by  (2.9),  (A.3)  and  (2.6),  respectively. 
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Only  the  configurations  with  a  =  5  and  j3  =  1, 3  are  plotted  here.  All  the  other 
configurations  show  similar  behavior,  therefore  are  omitted.  All  the  results 
show  that  the  Dey  and  Kuo  estimator  dominates  the  moment  and  ML-II 
estimators,  sometimes  by  a  very  small  amount. 

Figure  3  compares  the  EB  risks  of  the  three  estimators  for  various  r 
values,  where  p  is  known.  The  three  estimators  are  the  Bayes  estimators,  the 
moment,  and  the  ML-II  estimators.  The  parameters  a  in  the  two  latter 
estimators  are  computed  from  (2.10)  and  (A.2),  respectively.  Our  simulation 
results  show  that  the  ML-II  EB  dominates  the  Moment  EB  usually.  The 
improvement  of  the  ML-II  EB  over  the  Moment  EB  could  be  substantial  in 
many  cases.  The  exception  occurs  when  both  r  and  a  are  small,  where  the 
moment  EB  improves  upon  the  ML-II  EB  by  a  small  amount.  Only  two  cases 
with  a  =  5  and  =  1, 3  are  presented  here  for  short. 

All  the  figures  are  produced  by  the  GPLOT  procedure  of  the  SAS 
(Statistical  Analysis  System). 
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APPENDIX  ML-II  PRIOR  APPROACH  TO  EB  ESTIMATION 

In  this  appendix,  we  derive  the  maximum  likelihood  estimates  of  a  and 
from  the  joint  density  of  the  S/s  given  in  (2.3). 

To  maximize  (2.3),  we  can  equivalently  maximize  the  following 
logarithmic  function  of  (2.3) 

Z  r 

/K/^)  =  S  {lnr(a  +  ri)-lnr(a)+rjlnj3-(a  +  ;i)ln(S,-j3+l)  +  g(;i-,S,)},  (Al) 
i=l 


where  g  does  not  depend  on  a,  p. 

We  first  obtain  the  first  derivatives  of  /  and  set  them  to  0: 


da 


^  /M)  =  i{'f'(«  +  >!)-¥'(«)-lnW  +  l)}  =  0and  (A2) 

1=1 

where  'Fia)  =  -^In r(a)  and  Fia  +  r,)  =  ^-InFla  +  rA 
da  'da 

A  computer  program  using  the  bisection  method  has  been  written  to 
search  for  the  roots  of  (A.2)  and  (A.3). 

A 

Next  we  will  verify  (by  the  second  derivative  test)  whether  the  root  {a,p) 
is  a  local  maximum  of  /.  Let  us  first  evaluate  the  second  derivatives.  Using 
the  recurrence  formula  for  Fia+ri)  as  in  Abramowitz  and  Stegun  (1964,  p. 
258), 


‘P(a  +  ;i)  = 


1 


+...+— ^+-+'P(a), 


r,-l  +  a  ^•-2+a  1+a  a 


we  have 
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p 

i=l 


da 


\2  /„  «  .  ..\2  ^2 


(;j-l+a)  (;j-2+a)^  a^ 


<0 


(A4) 


(“■^) 


P 

1 

i=l 


,  A  ” 


(Sififi)?  (s,-4+if 


(using  A.  3) 


=i 

i=l  4(Si4+l) 


Let  '^~2f[^'P)  denote  the  2nd  partial  derivative  with  respect  to  a  evalu- 

A 

ated  at  {a, 15).  Similar  notations  are  defined  for  other  derivatives.  The  second 


(AS) 


derivative  test  states  that  if 


dfi^ 


-i2 


da^ 


i&.fi) 


and 


dadp 
d^ 


maximum  of  f{a,p).  Since  — jfia,p]  <  0,  we  need  only  program  the  second 

da^  '  ' 

condition  and  verify  it.  That  is,  we  need  to  show 

^2 


D  = 


1 


p  n 

S  S:.  .,2 1 

i=i  ;=i(a+)i-;)  J 


■f 

1  p4(s,-4^if 


y  _ §L 

M 


>0,  where  {a,P)  is 


the  solution  to  (A.2)  and  (A.3). 


14 


We  have  discussed  how  to  obtain  the  maximum  likelihood  estimates  of 
(A.l)  when  both  a  and  p  are  unknown.  For  the  case  that  p  is  known,  we 
maximize  fia,p)  by  solving  (A,2)  as  a  function  of  a.  There  is  a  imique  root  of 
(A.2)  which  maximizes  /(a,)3)  because  fia,p)  is  a  concave  function  of  a  as 
-  shown  in  (A.4).  For  the  other  case  that  a  is  known,  we  solve  (A.3)  as  a 
function  of  p.  This  root  maximizes  (A.1)  because  of  the  condition  in  (A.5). 
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